VIDEO AND AUDIO FUNCTIONS IN A WEB TELEVISION 
Related Applications 
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^^^-^-/^^ present invention is related to the inventions 

0^ disclosed in application U.V Serial No. (7009) which was 

5 filed on _, in appli^a^ U.S. Serial No. (7010) 

which was filed on , Vnd in application U.S. 

Serial No. (7012) which was fileV on 

Technical Field of the Invention 
3 ITa/S/J^^^ The present irWention relates to video and audio 

ICft functions in a web televllsion. 

^ Background of the Invention 

1_ The internet has become an integral part in the 

way in which content is delivered to end users. For exam- 
W pie, newspapers, magazines, and television and cable net- 

1^ works have web sites that are increasingly being used to 

deliver content. Content is delivered by on-line content 
providers which include, for example, web sites and on-line 
service providers such as AOL"^. 

Content is accessed by end users via on-line 
20 access devices. The on-line access device most often used 

currently is the personal computer. However, non-personal - 
computer on-line access devices are being, and have been, 
developed that enable end users to connect to the internet. 
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For example, one type of non-personal - computer on-line 
access device is a web television. 

A web television generally includes many of the 
components of a conventional television, such as a televi- 
sion controller, a video processor, an audio processor, and 
the like. However, unlike a conventional television, a web 
television also includes an internet module, which permits 
the web television to be used as an on-line access device, 
and an input device, which permits the user to interface 
with the internet module and the web television in order to 
communicate over the internet by way of the web television. 
Accordingly, a web television may be used in a manner simi- 
lar to a personal computer in order to gain access to on- 
line content providers. 

The television controller of a web television 
currently responds to inputs from the end user in order to 
control the web television in either a normal television 
mode or an internet mode. During the television mode, the 
television controller responds to instructions from the end 
user, usually by way of a remote control, in order to select 
and present television signals by way of the television's 
display and speakers. During the internet mode, the televi- 
sion controller transmits messages to the internet module 
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permitting the internet module to be used in order to commu- 
nicate over the internet. 

However, the television controllers of existing 
web televisions do not receive messages from their corre- 
sponding internet modules. Accordingly, the television con- 
trollers cannot determine the status of their corresponding 
internet modules, the software version numbers and revision 
numbers of the software being executed by their correspond- 
ing internet module, and other characteristics of the 
internet module which would be useful to the television 
controller. Also, current web televisions do not have 
integrated PIP functions (i.e., PIP functions that are 
internal to the web television and that do not require a set 
top internet box) which permit internet video from the 
internet module to be displayed in the PIP and which permit 
internet video from the internet module in the PIP to be 
swapped with television video from the television tuner of 
the web television. Moreover, current web televisions do 
not permit internet audio from the internet module to be 
swapped with television audio from the television tuner of 
the web television from a single integrated control source 
such as a television controller. 

The present invention solves one or more of the 
above noted problems. 



Docket ZEC DF7 011 




20 



Summary of the Invention 

In accord^pce with one aspect of the present 
invention, a web television comprises a display, a tuner, an 
internet module, a Plff module, and switching means. The 
tuner is arranged to stelect television video for display on 
the display. The inteAiet module is arranged to supply 
internet video for display on the display, and the internet 
video is derived from in\ternet communications between the 
web television and interAet content providers. The PIP 
module is arranged to provide a, PIP area in the display. 
The switching means switcAeg^he PIP area between the inter- 
net video and the televj 



)n 



In accordance witth another aspect of the present 
invention, a web television! comprises a display, a tuner, an 
internet module, and switching means. The tuner is arranged 
to select television audio fbr display by a speaker of the 
web television. The interneft module is arranged to supply 
internet audio for display byl the speaker of the web televi- 
sion, and the internet audio is derived from internet commu- 
nications between the web television and internet content 
providers. The switching meante switches the speaker of the 
web television between the internet audio and the television 
audio . 
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In accordance with yet another aspect of the 
present invention, a web television comprises a monitor, a 
tuner, an internet module,! and a switch. The tuner is 
arranged to select television video for display on the 
display. The internet modvile is arranged to supply internet 
video for display on the dibplay, and the internet video is 
derived from internet communications between the web televi- 



sion and internet content p 
to switch the display betwee:i 
television video. 

In accordance wit/h 
present invention, a web tel 
tuner, an internet module, a 
The tuner is arranged to sel 
on the display and to select 



►viders. The switch is arranged 
the internet video and the 




s^^i^j j. another a spect of the 
evision comprises a display, a 

PIP module, and swapping means, 
ect television video for display 
television audio for display by 



a speaker of the web television. The internet module is 
arranged to supply internet video for display on the display 



and to supply internet audio 



for display by the speaker of 



the web television, and the ihternet video and internet 
audio are derived from internt^t communications between the 
web television and internet content providers. The PIP 
module is arranged to provide a PIP area within a main area 
in the display. The swapping Tieans swaps the internet video 
and the television video between the PIP area and the main 



y 
icffi 



p 
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area in the display and swabs the internet audio and the 
television audio between the\ speaker of the web television. 

In accordance with\a further aspect of the present 
invention, a web television cWprises a display, a tuner, a 
PIP module, and an integrated television/internet control- 
ler. The tuner is arranged to Iselect television video for 
display on the display and to stelect television audio for 
display by a speaker of the web \ t^^Tevision. The PIP module 
is arranged to provide a PIP ar$^ yfithin a main a,rea of the 
display. The integrated televAs4ony^ntejjaet controller is 



arranged to supply internet vide( 
and to supply internet audio for 



for display on the display 
display by the speaker of 



the web television, wherein the internet video and internet 
audio are derived from internet CDmmunications between the 
web television and internet content providers. The inte- 
grated television/internet controller is also arranged to 
swap the internet video and the television video between the 
PIP area and the main area of th^ display and to swap the 
internet audio and the televisio^ audio between the speaker 
of the web television. 
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Brief Description of the Drawings 

These and other features and advantages of the 
present invention will become more apparent from a detailed 
consideration of the invention when taken in conjunction 
with the drawings in which: 

Figure 1 illustrates a web television arranged in 
accordance with the present invention; 

Figure 2 illustrates a communication system having 
an internet module and a television controller for control- 
ling the web television of Figure 1; 

Figure 3 illustrates a message format of a status 
command message written by the television controller to the 
internet module of Figure 2; 

Figure 4 illustrates a message format of a data 
page command message written by the television controller to 
the internet module of Figure 2; 

Figure 5 illustrates a message format of a trak- 
ball position command message written by the television 
controller to the internet module of Figure 2; 

Figure 6 illustrates a message format of a key- 
board page command message written by the television con- 
troller to the internet module of Figure 2; 
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Figure 7 illustrates a message format of a con- 
troller version command message written by the television 
controller to the internet module of Figure 2; 

Figure 8 illustrates a message format of a status 
response message read by the television controller from the 
internet module of Figure 2; 

Figure 9 illustrates a message format of an inter- 
net module response message read by the television control- 
ler from the internet module of Figure 2; 

Figures 10 - 13 illustrate a program which is 
executed by the television controller in writing messages 
to, and reading messages from, the internet module of Figure 
1 ; and , 

Figure 14 illustrates an alternative embodiment of 
a communication system having an integrated television/in- 
ternet controller for controlling the web television of 
Figure 1. 

Detailed Description 

A web television 10 is illustrated in Figure 1 and 
includes a display 12 (such as a CRT) housed in a cabinet 
14, The cabinet 14 also houses various switches 16 as well 
as an infrared sensor 18 that responds to an infrared remote 
control device 20. Alternatively, the remote control device 
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20 may be hardwired to the web television 10, or the remote 
control device 20 may transmit wireless signals of a kind 
other than infrared. The remote control device 20 may be a 
trakball type remote control, a conventional remote control, 
a keyboard type remote control, or the like, 

A communication medium 22 is connected to the web 
television 10 permitting the web television 10 to communi- 
cate with on-line content providers such as by way of the 
internet. The communication medium 22 may be a phone line, 
a cable, an integrated services digital network, a digital 
subscriber line (which may include an asymmetrical digital 
subscriber line, a rate adapted digital subscriber line, or 
the like) , a satellite link, or any other type of medium 
which supports communication between the web television 10 
and on-line content providers, 

A television control system 30 for controlling the 
operations of the web television 10 is illustrated in Figure 
2. The television control system 30 includes a television 
controller 32, an internet module 34, an audio/video switch 
36, a PIP module 38, a video processor 40, an audio proces- 
sor 42, a raster control 44, a communication bus 46, and a 
tuner 48. The internet module 34 may be any of the suitable 
commercially available devices that permit communication be- 
tween a television and on-line content providers. The 
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internet module 34 has an Ethernet port EN and a phone line 
port PL for connecting the internet module 34 to the commu- 
nication medium 22 so that the internet module 34 may trans- 
mit and receive information to and from remote on-line 
devices. The internet module 34 also has a port PRT for 
connecting the internet module 34 to a printer so that 
internet communications may be printed. 

The television controller 32 may be a micropro- 
cessor with corresponding memory and communication circuits 
for supporting communications over the communication bus 46 
between the television controller 32, the internet module 
34, the audio/video switch 36, the PIP module 38, the video 
processor 40, the audio processor 42, the raster control 44, 
and the tuner 48. The communication circuit of the tele- 
vision controller 32 includes a transmitter and a receiver. 
The communication bus 46 may be an IXC communication bus 
having serial control, data, and address lines. 

The audio/video switch 3 6 is controlled by the 
television controller 32 in order to supply internet commu- 
nications, which are supported by the internet module 34, 
and/or television signals, which are tuned by the tuner 48, 
to the PIP module 38, to the video processor 40, and to the 
audio processor 42. The PIP module 38, the video processor 
40, the audio processor 42, and the raster control 44 are 
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controlled by the television controller 32 in order to 
appropriately supply the internet communications and televi- 
sion signals to the display 12 and the speakers of the web 
television 10. 

Accordingly, the television controller 32, in 
response to appropriate signals from the remote control 
device 20, may control the audio/video switch 36, the PIP 
module 38, the video processor 40, the audio processor 42, 
and the raster control 44 so that (i) internet video is 
displayed on the display 12 and audio supported by the 
internet module 34 is provided to the speakers of the web 
television 10, (ii) television video is displayed on the 
display 12 and audio selected by the tuner 48 is provided to 
the speakers of the web television 10, (iii) internet video 
supported by the internet module 34 is displayed on the 
display 12 and television audio selected by the tuner 48 is 
provided to the speakers of the web television 10, (iv) 
internet audio supported by the internet module 34 is pro- 
vided to the speakers and television video selected by the 
tuner 48 is displayed on the display 12 of the web tele- 
vision 10, (v) internet video supported by the internet 
module 34 is displayed in a PIP area in the display 12, 
television video selected by the tuner 48 is displayed in 
the main area in the display 12, and either internet audio 
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or television audio is provided to the speakers of the web 
television 10, and/or (vi) television video selected by the 
tuner 48 is displayed in a PIP area of the display 12, 
internet video supported by the internet module 34 is dis- 
played in the main area of the display 12, and either inter- 
net audio or television audio is provided to the speakers of 
the web television 10. The television controller 32, in re- 
sponse to appropriate signals from the remote control device 
20, may also control the audio/video switch 36, the PIP 
module 38, the video processor 40, the audio processor 42, 
and the raster control 44 to swap internet video and televi- 
sion video between the PIP area and the main area, and to 
swap the speaker of the web television 10 between internet 
audio and television audio. 

Alternatively, a swapping function may be initi- 
ated by the internet module 34. For example, when the web 
television 10 is in internet mode so that an internet screen 
is displayed on the display 12, a button on the internet 
screen may be selected by the user through use of the remote 
control device 20 causing the internet module 34 to send a 
request for a PIP swap to the television controller 32. In 
response, the television controller 32 suitably controls the 
audio/video switch 36, the PIP module 38, the video proces- 
sor 40, the audio processor 42, and the raster control 44 to 
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swap internet video and television video between the PIP 
area and the main area, and/or to swap the speaker of the 
web television 10 between internet audio and television 
audio. As another example, when the web television 10 is in 
internet mode, the internet module 34 may determine that the 
reception of an internet communication is taking too long 
and, until reception is complete, is appropriating the main 
television unnecessarily. Accordingly, the internet module 
34 may send a request for a PIP swap to the television 
controller 32 causing the television controller 32 to swap 
internet video to the PIP area and television video to the 
main area, and/or to swap the speaker of the web television 
10 from internet audio to television audio, so that the user 
need not be bothered with the internet communication until 
its reception is complete. 

The communication bus 46 supports two-way communi- 
cation between the internet module 34 and the television 
controller 32. Examples of messages which may be used 
during such communication are shown in Figures 3-9 as mes- 
sages 60, 70, 80, 90, 100, 110, and 120. During communica- 
tion between the television controller 32 and the internet 
module 34, the television controller 32 operates as a master 
station by controlling communication between the television 
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controller 32 and the internet module 34 over the communica- 
tion bus 46 . 

Accordingly, as shown by each of the messages 60, 
70, 80, 90, 100, 110, and 120, the television controller 32 
initiates each communication between itself and the internet 
module 34 by transmitting a start signal, which may be a bit 
or bit sequence and which designates the start of the mes- 
sages 60, 70, 80, 90, 100, 110, and 120, followed by an 
appropriate slave address. The slave address (i) specifies 
the address of a module (such as the internet module 34), 
and (ii) designates whether the television controller 32 is 
writing to the communication bus 46 (i.e., transmitting) or 
reading from the communication bus 46 (i.e., receiving). 

As shown by each of the messages 60, 70, 80, 90, 
and 100 of Figures 3-7, a write slave address having a 
particular value, such as $44, is transmitted by the televi- 
sion controller 32 when the television controller 32 writes 
a message to the communication bus 46 and the message is 
intended for the internet module 34. As shown by each of 
the messages 110 and 120 of Figures 8 and 9, a read slave 
address having a particular value, such as $45, is trans- 
mitted by the television controller 32 when the television 
controller 32 determines to read information on the communi- 
cation bus 46 from the internet module 34, After the tele- 
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vision controller 32 transmits the start signal followed by 
the slave address, the television controller 32 waits for an 
acknowledgement (ACK) from the internet module 34. 

The message 60 illustrated in Figure 3 is trans- 
mitted to the internet module 34 whenever the television 
controller 32 has status information to transmit, such as in 
the event that (i) a change occurs which affects a mode bit 
in the message 60 (these mode bits are described below) , 
(ii) the television controller 32 receives a request from 
the internet module 34, in which case the message 60 is 
transmitted by the television controller 32 as an acknowl- 
edgement of the request, (iii) the internet module 34 fails 
to respond to a poll from the television controller 32 for a 
predetermined amount of time, (iv) the television controller 
32 receives a command from the user which switches the tele- 
vision controller 32 in or out of internet mode, or the 
like. 

Upon receipt of an acknowledgement (ACK) from the 
internet module 34, the television controller 32 transmits a 
status command byte (which may have a value of $00, for 
example) to indicate that the message 60 is a status message 
containing certain status information. This status informa- 
tion indicates to the internet module 34 the status of 
certain modes of the web television 10. The television con- 
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troller 32 then waits to receive from the internet module 34 
an acknowledgement of the command byte. Upon receiving this 
acknowledgement, the television controller 32 transmits a 
mode byte. 

The mode byte, for example, may be eight bits in 
length and may be used for a variety of purposes . The mode 
byte may have (i) a first bit which indicates whether the 
web television 10 is off or on, (ii) a second bit which 
indicates a television receiver configuration or model, 
(iii) a third bit which indicates whether the main area of 
the display 12 is to contain internet video received by the 
internet module 34 or television video of a television 
signal selected by the tuner 48, (iv) a fourth bit which 
indicates whether the speakers of the web television 10 are 
supplied with internet audio received by the internet module 
34 or television audio of a television signal selected by 
the tuner 48, (v) a fifth bit which indicates whether the 
PIP module 38 is on or off, (vi) a sixth bit which indicates 
whether a screen saver mode is on or off, and (vii) two bits 
for the like purposes. 

The information contained in these mode bits may 
indicate the results of commands from the end user by way of 
the television controller 32 or from the internet module 34. 
For example, if the end user desires to place internet video 
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in the main area of the display 12 and to place television 
video in the PIP area of the display 12, the end user will 
do so by use of the remote control device 20 which causes 
the television controller 32 to send commands in order to 
control the audio/video switch 36, the PIP module 38, the 
video processor 40, the audio processor 42, the raster 
control 44, and/or the tuner 48, as appropriate. The re- 
sults of these control actions affect the mode bits, causing 
the television controller 32 to send the message 60 to the 
internet module 34. As another example, the internet module 
34 may transmit a request to the television controller 32 
that internet video be placed in the main area of the dis- 
play 12 and that television video be placed in the PIP area 
of the display 12, Such a request may result from a selec- 
tion by the end user of an appropriate button in an internet 
screen supplied to the display 12 by the internet module 34. 
As a result of the request, the television controller 32 
sends commands to control the audio/video switch 36, the PIP 
module 38, the video processor 40, the audio processor 42, 
the raster control 44, and/or the tuner 48, as appropriate. 
This action also affects the mode bits, causing the televi- 
sion controller 32 to send the message 60 to the internet 
module 34 as an acknowledgement of the request transmitted 
by the internet module 34 to the television controller 32. 
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Following transmission of the mode byte, the 
television controller 32 waits for an acknowledgement from 
the internet module 34, Upon receipt of the acknowledge- 
ment, the television controller 32 transmits a request byte 
which, for example, may be used to request the internet 
module 34 (i) to transmit back its version ID (which may be 
useful for diagnostic purposes) , (ii) to reset the internet 
module 34 (such as when the web television 10 is turned off 
by the end user, when the internet module 34 fails to ac- 
knowledge the communication bus 4 6 for more than a prede- 
fined limit of time, or when the internet module 34 other- 
wise requires reset), or the like. A request that the 
internet module 34 reset itself causes the internet module 
34 to transmit back a status message indicating compliance. 

After transmittal of the request byte, the televi- 
sion controller 32 waits for an acknowledgement. Upon 
receipt of the acknowledgement, the television controller 32 
transmits a stop signal (such as a bit or bit sequence) 
designating the end of the message 60. 

The messages 70, 80, and 90 are illustrated in 
Figures 4, 5, and 6. The messages 70, 80, and 90 are simi- 
lar to the message 60 of Figure 3 in that the messages 70, 
80, and 90 are initiated with a start signal followed by the 
write slave address indicating that information is to be 
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transmitted by the television controller 32 to the internet 
module 34, Upon receipt of an acknowledgement from the 
internet module 34, the television controller 32 transmits a 
remote control command byte (which may have a value of $01, 
for example) to indicate that the messages 70, 80, and 90 
contain remote control information which has been trans- 
mitted by the remote control device 20 to the television 
controller 32 and which may be useful to the internet module 
34. After acknowledgement of this remote control command 
byte, the television controller 32 next transmits a remote 
control page byte which indicates that certain remote con- 
trol page information follows. 

For example, as shown in Figure 4, the remote 
control page byte of the message 70 is a data page byte 

(containing a value of $09, for example) to indicate that 
the message 70 includes a data byte. After transmitting the 
remote control data page byte, the television controller 32 
waits for an acknowledgement. Upon receipt of the acknowl- 
edgement, the television controller 32 transmits the data 
byte. The data byte may be used to transmit trakball push 

(click) data in the case where the remote control device 20 
has a trakball and the trakball has been pushed, enter key 
push (click) data in the case where the remote control 
device 20 has an enter key and the enter key has been 
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pushed, and the like. After transmittal of the data byte, 
the television controller 32 waits for an acknowledgement 
from the internet module 34. Upon receipt of the acknowl- 
edgement, the television controller 32 transmits a stop 
5 signal designating the end of the message 70. 

The message 80, which is shown in Figure 5, is 
transmitted by the television controller 32 in order to 
convey displacement information to the internet module 34. 
For example, the displacement information transmitted in the 
(ft message 80 may include the x and y position of a cursor or 

Y} highlighting or the like, as selected by movement of a trak- 

M ball on a trakball type remote control. As another example, 

D the displacement information transmitted in the message 80 

p may include the x and y position of a cursor or highlighting 

%k or the like, as selected by arrow keys on either a conven- 

Q tional remote control, a keyboard remote control, or a 

^ trakball remote control. 

The message 80 includes the start signal, the 
write slave address, the remote control command byte, and 
0 the remote control page byte described above. However, 

unlike the remote control page byte of the message 70, the 
remote control page byte of the message 80 is an X-Y posi- 
tion page byte (containing a value of $14, for example) to 
indicate that displacement information is contained in the 
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message 80. Accordingly, as indicated in Figure 5, upon 
receipt of an acknowledgement following transmission of the 
remote control page byte, the television controller 32 
transmits X and Y position bytes. The X position byte 
designates a current X position of a cursor, highlighting, 
or the like, as selected by a trakball, by arrow keys, or 
the like. The Y position byte similarly designates a cur- 
rent Y position of a cursor, highlighting, or the like, as 
selected by a trakball, by arrow keys, or the like. Upon 
receipt of an acknowledgement after transmission of each of 
the X and Y position bytes, the television controller 32 
transmits a stop signal designating the end of the message 
80. 

The message 90, which is shown in Figure 6, is 
transmitted by the television controller 32 in order to 
convey alpha and/or numeric character data or the like to 
the internet module 34, For example, when the web televi- 
sion 10 is in internet mode and the remote control device 20 
transmits characters (such as alpha and/or numeric charac- 
ters) to the web television 10, the television controller 32 
responds by transmitting the characters to the internet 
module 34 by way of the message 90, The message 90 includes 
the start signal, the write slave address, the remote con- 
trol command byte, and the remote control page byte de- 
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scribed above. However, unlike the remote control page 
bytes of the messages 70 and 80, the remote control page 
byte of the message 9 0 is a keyboard page byte (containing a 
value of $15, for example) to indicate that character data 
is contained in the message 90. Accordingly, as indicated 
in Figure 6, upon receipt of an acknowledgement following 
transmission of the remote control page byte, the television 
controller 32 transmits the last keystroke followed by the 
current keystroke. Following suitable acknowledgements, the 
television controller 32 transmits a stop signal designating 
the end of the message 90. 

The television controller 32 transmits a message 
100 as illustrated in Figure 7 in order to convey to the 
internet module 34 the revision and version numbers of the 
television controller 32, The message 100 includes the 
start signal and the write slave address described above. 
Following acknowledgement of the write slave address byte by 
the internet module 34, the television controller 32 trans- 
mits a version command byte in the message 100, The version 
command byte of the message ^100 (containing a value of $04, 
for example) indicates that the message 100 contains the 
revision and version numbers of the television controller 
32. The revision and version numbers of the television 
controller 32 may be useful to the internet module 34 in 
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determining which of its features are compatible with the 
software executed by the television controller 32 and, 
therefore, should be initialized. 

As indicated above, when the television controller 
32 is ready to read information which it previously request- 
ed from the internet module 34, or when the television 
controller 32 is ready to poll the internet module 34, it 
transmits a read slave address over the communication bus 
46. Accordingly, as shown in Figures 8 and 9, this read 
slave address may have a value of $45, for example. The 
internet module 34 will then return the previously requested 
information and/or its status in a message format such as 
that shown in Figures 8 and 9 . 

The message 110 shown in Figure 8 includes a start 
signal, as described above, and a read slave address, both 
of which are transmitted by the television controller 32. 
Generally, a read slave address, which does not follow a 
previous request by the television controller 32 for specif- 
ic information from the internet module 34 (such as version 
and revision numbers) , indicates that the television con- 
troller 32 is polling the internet module 34. Following 
transmission of the start signal and the read slave address, 
the television controller 32 waits for an acknowledgement 
from the internet module 34 and an additional byte which. 
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for example, may have a status indicating byte as shown in 
Figure 8 or a version indicating byte as shown in Figure 9. 

In the message 110, a status indicating byte 
(containing a value of $00, for example) indicates that mode 
and status information bytes follow. The mode byte in the 
message 110 may be used to indicate certain information such 
as (i) whether the internet module 34 is active and has been 
initialized, (ii) whether the internet module 34 is connect- 
ed to a phone line or whether the internet module is off- 
line, (iii) whether the internet module 34 is connected to 
the Ethernet, and (iv) other possible information such as 
whether the internet module 34 is executing Web Browser, 
Email, User Setup, or other applications. Following receipt 
of the status indicating and mode bytes, the television 
controller 32 transmits corresponding acknowledgements and 
then waits for a status byte. 

The status byte received by the television con- 
troller 32 may indicate whether internet audio or television 
audio is being supplied to the speaker of the web television 
10, whether a Screen Saver mode of the internet module 34 is 
on or off, and the like. Following receipt of the status 
byte, the television controller 32 transmits an acknowledge- 
ment and waits for a request byte. 
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The request byte from the internet module 34 may 
request the television controller 32 to perform one or more 
of the following functions: (i) transmit its version ID; 
(ii) execute a PIP swap function; (iii) execute a PIP off 
function; (iv) execute a PIP on function; (v) switch the 
video output of the internet module 3 4 into the main area of 
the display 12; (vi) switch the video output of the tuner 
48 into the main area of the display 12; and the like. 

Many of these requests result when the user, by 
use of the remote control device 2 0 for example, clicks on 
an appropriate button of an internet screen which the inter- 
net module 34 causes to appear on the display 12 of the web 
television 10. The click information is transmitted by the 
television controller 32 in the messages 70, 80, and 90, as 
appropriate, and the selected buttons are then transmitted 
by the internet module 34 to the television controller 32 as 
requests so that the television controller 32 can take 
appropriate action with respect to the audio/video switch 
36, the PIP module 38, the video processor 40, the audio 
processor 42, and the raster control 44, Additionally, the 
television controller 32 transmits the message 100 to the 
internet module 34 in response to function (i) above, and 
the television controller 32 transmits the message 60 to the 
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internet module 34 in response to functions (ii) , (iii) , 
(iv) , (v) , (vi) , and the like. 

Following receipt of the request byte, the televi- 
sion controller 32 transmits an acknowledgement and waits 
for a checksum byte. All messages which are sent from the 
internet module 34 to the television controller 32 over the 
communication bus 46 may use a checksum at the end of the 
message for detection of transmission errors. This checksum 
may be the two's complement of the sum of all bytes trans- 
mitted in the message, not including the device address. In 
this way, the sum of all bytes following the device address 
will be zero. If this checksum is not zero, the message 
will not be processed by the television controller 32 and 
the television controller 32 will require a retransmission, 
of the message from the internet module 34. Following 
receipt of the checksum byte, the television controller 32 
transmits a HIGH line level followed by a stop signal. 

The message 120 as illustrated in Figure 9 is 
transmitted so that the internet module 34 may respond to 
the message 60 having its request byte set to request ver- 
sion and revision numbers from the internet module 34. The 
message 12 0 includes the start signal and the read slave 
address of the message 110. Following transmission of the 
start signal and the read slave address, the television 
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controller 32 waits for an acknowledgement followed by a 
byte having a value indicating that version identification 
information from the internet module 34 follows. For exam- 
ple, this byte may have a value of $03, Following receipt 
of this version identification indicating byte, the televi- 
sion controller 32 transmits, to the internet module 34, an 
acknowledgement that it has received the version identifica- 
tion indicating byte. 

Upon receipt of this acknowledgement, the internet 
module 34 transmits a software revision number byte. Fol- 
lowing receipt of the software revision number byte, the 
television controller 32 transmits an acknowledgement and 
then waits for a software version byte. 

Upon receipt of this acknowledgement, the internet 
module 34 transmits the software version number byte. Fol- 
lowing receipt of the software version number byte, the 
television controller 32 transmits an acknowledgement and 
then waits for a checksum byte. 

Following receipt of the checksum byte, the tele- 
vision controller 32 transmits a HIGH line level and a stop 
signal . 

Figures 10-13 illustrate an example of a program 
200 which may be executed by the television controller 32 in 
order to facilitate the transmission and reception of the 
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messages 60-120 over the communication bus 46. The program 
200, for the most part, is an event - initiated program. In 
general terms, the events are either user- selected events 
(for example, events selected by the user through use of the 
remote control device 20) or polling events. In the case of 
user- selected events, a block 202 determines whether the 
event is an user instruction to turn on the web television 
10. If so, a block 204 transmits messages to the tuner 48, 
the audio/video switch 36, the video processor 40, and the 
audio processor 42 to begin displaying video and audio on 
the web television 10. The block 204 also transmits, to the 
internet module 34, the message 60 with the first bit of the 
message 60 set to indicate that the web television 10 is on. 

A block 206 determines whether the event is an 
user instruction to turn off the web television 10. If so, 
a block 208 transmits messages to the audio/video switch 36, 
the video processor 40, the audio processor 42, and the 
tuner 48 to turn off the web television 10. The block 208 
also transmits, to the internet module 34, the message 60 
with the first bit of the message 60 set to indicate that 
the web television 10 is off. 

A block 210 determines whether the event is an 
user instruction or an internet module 34 request to turn on 
the PIP area. If so, a block 212 transmits a message to the 

- 28 - 
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PIP module 38 in order to initiate PIP operation. The block 
212 also transmits, to the internet module 34, the message 
60 with the fifth bit of the message 60 set to indicate that 
PIP operation has been initiated. 

A block 214 determines whether the event is an 
user instruction or an internet module 34 request to turn 
off the PIP area. If so, a block 216 transmits a message to 
the PIP module 38 in order' to conclude PIP operation. The 
block 216 also transmits, to the internet module 34, the 
message 60 with the fifth bit of the message 60 set to 
indicate that PIP operation has been concluded. 

A block 218 determines whether the event is an 
user instruction or an internet module 34 request to perform 
a PIP swap. If so, a block 220 transmits a message to the 
audio/video switch 36 in order to swap video between the PIP 
display and the main area of the display 12. The block 220 
also transmits, to the internet module 34, the message 60 
with the third bit of the message 60 set to indicate that 
internet video or television video, as appropriate, is in 
the main area of the display 12. If internet video is in 
the PIP area and television video is in the main area before 
the swap so that internet video is in the main area and 
television video is in the PIP area after the swap, the 
internet video after the swap may be wrapped around the PIP 
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area so that none of the internet conununication being dis- 
played is covered over by the PIP area. This wrapping may 
be implemented by the internet module 34 itself, or the 
television controller 32 may implement wrapping by suitable 
control of the video processor 40 and the raster control 44. 
This wrapping capability provides a distinct advantage over 
set top box type web televisions. 

A block 222 determines whether the event is an 
user instruction or an internet module 34 request to place 
internet video from the internet module 34 in the main area 
of the display 12. If so, a block 224 transmits a message 
to the audio/video switch 36 in order to place internet 
video from the internet module 34 in the main area of the 
display 12, The block 224 also transmits, to the internet 
module 34, the message 60 with the third bit of the message 
60 set to indicate that internet video from the internet 
module 34 should be in the main area of the display 12. 

A block 22 6 determines whether the event is an 
user instruction or an internet module 34 request to place 
television video from the tuner 48 in the main area of the 
display 12. If so, a block 228 transmits a message to the 
audio/video switch 36 in order to place television video 
from the tuner 4 8 in the main area of the display 12. The 
block 228 also transmits, to the internet module 34, the 
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message 60 with the third bit of the message 60 set to indi- 
cate that television video from the tuner 48 should be in 
the main area of the display 12 , 

A block 230 determines whether the event is an 
user instruction to connect television audio from the tuner 
48 to the speakers of the web television 10. If so, a block 
232 transmits a message to the audio/video switch 36 in 
order to connect television audio from the tuner 48 to the 
speakers of the web television 10, The block 232 also 
transmits, to the internet module 34, the message 60 with 
the fourth bit of the message 60 set to indicate that tele- 
vision audio from the tuner 48 is connected to the speakers 
of the web television 10. 

A block 234 determines whether the event is an 
user instruction to connect internet audio from the internet 
module 34 to the speakers of the web television 10, If so, 
a block 236 transmits a message to the audio/video switch 36 
in order to connect internet audio from the internet module 
34 to the speakers of the web television 10. The block 236 
also transmits, to the internet module 34, the message 60 
with the fourth bit of the message 60 set to indicate that 
internet audio from the internet module 34 is connected to 
the speakers of the web television 10. 
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A block 238 determines whether the event is a 
click of a trakball of a trakball remote control device 20, 
of an enter key of a keyboard or other remote control device 
20, or the like. If so, a block 240 sends the message 70 to 
the internet module 34 to indicate the click. A block 242 
determines whether the event is a change in cursor position 
as selected by use of a trakball of a trakball remote con- 
trol device 20, by arrow keys of a keyboard or other remote 
control device 20, or the like. If so, a block 244 trans- 
mits the message 80 in order to transmit the displacement 
information to the internet module 34. A block 246 deter- 
mines whether the event is a key stroke of a keyboard remote 
control device 20. If so, a block 248 transmits the message 
90 in order to transmit the last keystroke and the current 
keystroke to the internet module 34. 

A block 250 determines whether the event is a 
request from the internet module 34 for the version of the 
software executed by the television controller 32. If so, a 
block 252 transmits, to the internet module 34, the message 
100 containing the revision and version numbers of the 
software executed by the television controller 32. 

Polling is a timed event. When a timed event 
occurs, or if the television controller 32 otherwise deter- 
mines to read information from the internet module 34, a 
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block 300 initiates the transmission of an appropriate 
message such as the message 110 or the message 120. A block 
302 awaits the receipt of the bytes subsequent to the read 
slave address byte of the message 110 or the message 120. 
As each byte subsequent to the read slave address byte of 
the message 110 or the message 120 is received by the tele- 
vision controller 32, a block 304 appropriately processes 
the received data and transmits acknowledgements. 

As shown in Figure 14, the functions of the tele- 
vision controller 32 and of the internet module 34 may be 
integrated within the same processing block, such as a 
television/internet controller 400. The television/internet 
controller 400 communicates with on-line content providers 
and provides internet communications to an audio/video 
switch 402. The audio/video switch 402 also receives tele- 
vision signals as selected by a tuner 404. As in the case 
of the audio/video switch 36, the audio/video switch 402 
provides internet and/or television video to a PIP module 
406 and to a video processor 408, and provides internet 
and/or television audio to an audio processor 410. The 
television/internet controller 400 suitably controls the au- 
dio/video switch 402, the PIP module 406, the video proces- 
sor 408, the audio processor 410, and a raster control 44 in 
the same fashion as is described in connection with Figure 
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2. The television/internet controller 400 may be micropro- 
cessor based and programmed to incorporate all of the func- 
tions described above in connection with the television 
controller 32 and the internet module 34. 

Certain modifications of the present invention 
have been discussed above. Other modifications will occur 
to those practicing in the art of the present invention. 
For example, each portion of the messages 60, 70, 80, 90, 
100, 110, and 120 is described above as a single byte. 
Instead, each portion of the messages 60, 70, 80, 90, 100, 
110, and 120 may be comprised of several bytes or one or 
more other data units, 

Accordingly, the description of the present inven- 
tion is to be construed as illustrative only and is for the 
purpose of teaching those skilled in the art the best mode 
of carrying out the invention. The details may be varied 
substantially without departing from the spirit of the 
invention, and the exclusive use of all modifications which 
are within the scope of the appended claims is reserved. 



